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^ ' Abstract 

P-i, 

The problem of detecting a wide-sense stationary Gaussian signal process embedded in white Gaus- 
sian noise, where the power spectral density of the signal process exhibits uncertainty, is investigated. 
The performance of minimax robust detection is characterized by the exponential decay rate of the miss 



CO 



probability under a Neyman-Pearson criterion with a fixed false alarm probability, as the length of the 
observation interval grows without bound. A dominance condition is identified for the uncertainty set 
of spectral density functions, and it is established that, under the dominance condition, the resulting 
minimax problem possesses a saddle point, which is achievable by the likelihood ratio tests matched 
to a so-called dominated power spectral density in the uncertainty set. No convexity condition on the 

o\ , 

■ uncertainty set is required to establish this result. 
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Dominance, error exponent, minimax robustness, Neyman-Pearson criterion, power spectral density, 
wide-sense stationary Gaussian processes 
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c3 ■ I- Introduction 

Many signal detection problems can be modeled by the following hypothesis testing problem: 

Y n = N n , n = 0,l,...,iV-l, 

Y n = S n + N n} n = 0,l,...,iV-l, (1) 

The work of W. Zhang was supported in part by Program for New Century Excellent Talents in University (NCET), and the 
Fundamental Research Funds for the Central Universities. The work of H. V. Poor was supported in part by the U.S. Office of 
Naval Research under Grant N00014-09-1-0342. 

W. Zhang is with Department of Electronic Engineering and Information Science, University of Science and Technology of 
China, Hefei 230027, China. Email: wenyizha@ustc.edu.cn. H. V. Poor is with Department of Electrical Engineering, 
Princeton University, Princeton, NJ, USA. Email: poor@princeton.edu. 



May 3, 2010 



DRAFT 



where N denotes the length of the observation interval. The noise samples {N n } are independent 
and identically distributed (i.i.d.) Gaussian random variables with zero means and variances a 2 , 
i.e., N n ~ N(0,cr 2 ). The stochastic signal, {S n }, is a wide-sense stationary (WSS) Gaussian 
process with mean zero and power spectral density (PSD) (j>(u), to 6 [— it, tt]. 

For each N, the hypothesis testing problem is between two iV-dimensional zero-mean Gaussian 
distributions, and we shall denote a detector by 5n(-), which maps the iV-dimensional observation 
V — [2/0 > V\i ■ ■ ■ > Un-i\ T into {!K ,JCx}. As N grows without bound, the detectors 61,62,... 
constitute an infinite sequence, denoted by 6. 

To characterize the discrimination capability for a specific detector sequence, a convenient 
performance metric is the exponential decay rate of the miss probability (i.e., the probability of 
deciding 0~C when "Ki is true) as N grows without bound, under a Neyman-Pearson criterion 
that the false alarm probability (i.e., the probability of deciding IK4 when "Kq is true) is fixed as 
a constant < a < 1. Mathematically, the exponential decay rate is given by 

lim log Prob[MH) = Kol^i]. (2) 

N— s-oo 1\ 

Likelihood ratio tests (LRTs) achieve the maximal exponential decay rate, and we call this 
maximum the error exponent. For the detection problem (0Q), the error exponent is given by (see, 
e.g., [1] and references therein) 

1 



47T 



]og(l + ^ )/a 



cLj, (3) 



for every < a < 1. Indeed, T is the limit of a (normalized) Kullback-Leibler distance, 
(l/A/")D(piv,o||pjv)> as N grows without bound, where pjv,o denotes the A^-dimensional probability 
density function (PDF) of Y_ under J£ , and j9 W denotes the iV-dimensional PDF of Y_ under CKi, 
induced by the signal PSD 0(o;). 

In order to achieve ©, a sequence of LRT detectors (or frequency-domain correlation detectors 
[2]) need to be built with the exact knowledge of the signal PSD (j>(u), to E Due 
to practical limitations, however, the knowledge of 4>(oS) may usually be imprecise. Under 
such modeling uncertainty, the signal PSD </>(•) is known only to be within a set U<f, of PSD 
functions. Hence, neither the LRT detectors nor the frequency-domain correlation detectors can 
be implemented, and it is usually desirable to design robust detectors according to a minimax 
criterion (see, e.g., [3]). The philosophy of the minimax criterion is as follows. The engineer 
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first chooses a sequence of detectors 8, and Nature subsequently responds with a model from 
Ufa which leads to the worst performance for that sequence of detectors. The engineer's task, 
naturally, is to choose 5_ such that the resulting worst performance is optimized. As previously 
discussed, the performance in this paper is the exponential decay rate of the miss detection 
probability under a fixed false alarm probability. So we can define the minimax robust error 
exponent as 

r M R = max inf lim -— logProb[<fo(Y) = JUJCi], (4) 

where A Q denotes the set of all the detector sequences that achieve a fixed false alarm probability 

< a < 1. 

An upper bound to the minimax robust error exponent T MR is 



assuming that a genie provides the actual </>(•) to the engineer before choosing the detector 
sequence. 

Generally speaking, genie-aided upper bounds as in © are not achievable for minimax 
robustness problems, unless the problem possesses certain structural properties, say, possessing a 
saddle point; see, e.g., [3] and references therein for various formulations and approaches to such 
minimax robustness problems. A minimax robustness problem can be viewed as a game between 
two players [4], one choosing a filter, which is the sequence of detectors 6 here, and the other 
choosing an operating point which is the model realization </>(•) here. Typically, the existence 
of saddle points requires the space of operating points be a convex set; see, e.g., [4]. Robust 
decision problems have been studied extensively under various criteria like Bayes risk, error 
probabilities, generalized signal-to-noise ratio, etc.; see, e.g., [5]-[12]. The minimax robustness 
problem © regarding the error exponent of detecting a stationary Gaussian process with PSD 
uncertainty in white Gaussian noise has been studied (among other more general problems) in 
[13] and [14], where sufficient conditions are presented under which exponential decay rates 
of false alarm and miss probabilities are guaranteed. For hypothesis testing problems in which 
candidate hypotheses are characterized by moment classes, the asymptotic minimax robustness 
was investigated in [15]. 

In this paper, we establish that, under a dominance condition among the PSDs in Ufa the 
minimax robust error exponent problem © possesses a saddle point solution, and the minimax 
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robust error exponent is achievable by the LRT detectors with respect to the so-called dominated 
PSD. The dominance condition appears to be a novel property, and imposes no requirement on 
the convexity of U^,. 

The main result of our paper is the following. 

Theorem 1: For an arbitrary uncertainty set U^, if there exists a PSD </>*(•) G tl^, such that 
the following dominance condition 

holds for every (/>(■) G U<f>, then the sequence of LRT detectors with respect to </>*(■) achieves 
the minimax robust error exponent 



r _ 1 



duo, (7) 



l + 0*(w)/a 2 _ 

for every false alarm probability < a < 1. If </>*(•) exists, then it is unique. 

Theorem Q] is surprising, since the dominance condition © does not require be convex, 
or generated by 2-alternating capacities (see, e.g., [16]), or described by moment classes (see, 
e.g., [15]). Also, when </>*(•) exists, Theorem \T\ not only suggests the existence of, but also 
explicitly gives, the sequence of detectors that achieve r M R- Furthermore, due to the concavity 
of logarithmic functions, it follows that, the sequence of LRT detectors with respect to </>*(•) 
also solves the minimax robustness problem dU) when the uncertainty set is enlarged to its 
convex hull, yielding the same minimax robust error exponent r M R- 

Exemplifications of the dominance condition: 

• Define the lower envelope function of IX^ by Ei(u) = mi{(f)(u) : V(f)(u) G U^}, lu G [— 7T, 7r]. 
If £?{(•) G U , then it is </>*(•). 

• If <p(ui) = pa 2 G 11^, and every element of satisfies 



1 

then = pa 2 . 



log 



a z p 



:i+p) 



2 



du>log- — , (8) 



• If a 2 is substantially larger than all the elements of uniformly, i.e., very low signal-to- 
noise ratio, then © is approximated as 



1 

2vra 4 



<f>*(u) [<f>{u) - 4>*(u)] dtu > 0, (9) 
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which leads to 




/ [(j)*(uj)f duo < / 0*(w)0(w)dw, 



(10) 



J — 7T J — 7T 



as the criterion for 0*(-). 
We devote the remaining parts of this paper to the proof of Theorem [JJ In this section, we 
outline the key ideas in the proof as follows. We start with an arbitrary finite number, K, of 
PSD functions, one of them being a </>*(•) satisfying ©, and the other K — 1 arbitrarily sampled 
from U^, denoted {(fii(-) , 4> 2 (-) , ■ ■ ■ ,4>k()} where we let 0i(-) = </>*(•)• Then, instead of these 
K isolated PSD functions, we "convexify" the problem and consider, for each N, the set of 
mixture probability distributions over the K iV-dimensional Gaussian distributions induced by 
{a 2 + (f>i(-), cr 2 + 4>2{-), ■ ■ ■ , cr 2 + cj) K {-)}. Since this set of mixtures is a convex set, we exploit 
results in the minimax robustness theory (see, e.g., [4]) to establish that, under the dominance 
condition ©, the following Kullback-Leibler distance 



is achievable as a lower bound to the error exponent as iV grows sufficiently large. Here, 
Pn,o denotes the ^-dimensional Gaussian noise distribution under !K , p^,k denotes the N- 
dimensional Gaussian distribution induced by a 2 + 0fc(-), r e [0, 1]^ denotes the ^-dimensional 
mixture vector satisfying J2k=i r k = 1> an d 7 is the set of all mixture vectors. Now, as iV grows 
without bound, we show that, under the condition ©, the value of ([TT]) converges to 



which we see is the minimax robust error exponent, Tmr by noting that 0i(-) = </>*(■)■ Since we 
have established that Tmr is achievable over the set of mixture distributions, it is also achievable 
over the smaller set of K ^-dimensional Gaussian distributions induced by the K PSD functions 
{a 2 + 0i(-), cr 2 + 4>2(-), • • • , cr 2 + 4>k{-)}- From the above procedure, we establish that for every 
K-point set {</>i(-)> <f>2{-), 0i<r( - )} wn erc 0i(-) = </>*(•), there exists a sequence of detectors 
that achieves Tmr over that fT-point set. 

Although the Kullback-Leibler distance with respect to the mixture distribution, (PTTI) . converges 
to (fT2l) . this by no means implies that the minimax robust detector sequence asymptotically 
converges to the LRT for Gaussian distributions. Generally speaking, the minimax robust detector 




(ID 



lim —D {p Nfl 1 1 p Ni i) 



(12) 
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sequence may be the LRT for a sequence of mixture Gaussian distributions. In order for the 
minimax robust detector sequence to be the LRT for Gaussian distributions, it is necessary for 
the solution of the minimization problem CCD) to be a "singleton", i.e., all but one component of 
r are zeros. Applying the Karush-Kuhn-Tucker (KKT) conditions, we show that the dominance 
condition © also warrants that the minimization problem (ITTb can be solved by the sequence 
of LRT detectors with respect to (/>*(•), hence concluding the proof of Theorem [TJ 

II. PSD Uncertainty Set that Possesses a Dominance Structure 

For a given sample space Cl and its associated cr-algebra J, we start with three arbitrary 
probability measures P , Pi and P2, in which both Pi and P2 are absolutely continuous with 
respect to Po- We define a dominance relation as follows. 

Definition 1: If it holds that 

dP 2 /dP , 

" -dP < 1, (13) 

Po 



n dPi/dP 

then Pi is dominated by P 2 with respect to P , a condition denoted by Pi -< P 2 . We call P the 
reference probability measure. 

The following lemma immediately follows from Definition \T\ 

Lemma 1: Unless dPi/dPo and dP 2 /dPo are P -almost surely equal, the two dominance 

Po Pa 

relationships Pi -< P 2 and P 2 -< Pi cannot simultaneously hold. 

1—1 p ° p ° 

Proof: We prove LemmaLUby contradiction. Assume Pi -< P 2 and P 2 -< Pi hold simultaneously; 



that is, 

dP 2 /dP 
n dPi/dP 
dPi/dP 



n 



dP 2 /dP 

Summing these two inequalities leads to 



dP < 1, 
dP n < I- 



f f dPi/dP dP 2 /dP \ 

L {mJdPo + dpJdPo) dPo - 2 - (14) 

In (fl4)) . however, the left hand side is lower bounded by 

f f dPi/dP dP 2 /dP \ r 

J n \dP 2 /dP + dPi/dPo) ° ^ Jn 



IdPi/dPo dP 2 /dP 



2 

+ 2 



dP 2 /dP y dPi/dP 
> 2 / dP = 2. (15) 



n 
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Hence the only possible case is where dPi/dP Q = dP 2 /dP except on a subset of Q whose 
Po-measure is zero. But this case has already been excluded in the condition. So we arrive at a 
contradiction and Lemma Q] is established. □ 

Now for a set of probability measures, we can define its dominance property if it contains an 
element probability measure that is dominated by all the others in the set. 

Definition 2: Consider the sample space f2, its associated cr-algebra 3 r , a reference probability 

measure P , and a set of probability measures CP. A probability measure P* G CP is dominated 

Po 

by CP with respect to P if for every P G CP, P* -< P. We denote the dominance relationship by 

P* -< CP. 

In light of Lemma [H the following lemma is immediate. 

Lemma 2: A probability measure P* G CP that is dominated by CP with respect to P , if it 
exists, is unique. 

We also note that in general a set of probability measures CP may not contain a dominated 
element. As a simple example, consider a binary sample space Vl = {0, 1}, over which P is 
given by the probability mass function (PMF) Po(0) = Pq(1) = 0.5. For the set CP of two PMF's: 



Pi(0) = 0.9, Pa(l) = 0.1; P 2 (0) = 0.1, P 2 (L 



0.9, 



it is easily verified that neither P 1 nor P is dominated. 

For n = M. N , consider iV-dimensional zero-mean Gaussian distributions. Fix the reference 
probability measure P ~ N(0, c^Lvxat). Consider Pi ~ N(0, Si) and P 2 ~ N(0, S 2 ). From 

N(0,<T 2 I) 

Definition [U let us examine the conditions for N(0, Si) -< N(0, S 2 ). We have, 

W(0,<T 2 I) 

N(0,Si) -< K(0,S 2 )^ 



(2^)^/2 

1 



i^ 7f exp[-I^Sr 1 x](27r^)^ 



ISJ 1 / 2 



R iv (2 7 ra 2 ) Ar / 2 |S 2 | 1 /2 



cxp 





Si 




|s 2 




i+^s^-sr 1 )! 



2* 

1/2 



exp 



sr 1 + 



2a 



x T x 



dx < 1 



(7- 



C&E < 1 



< 1 



(16) 



=> IS^SiI < |I + a 2 (S^ 1 - S^ 1 ) |. 

In the above steps, it is implicitly required that the matrix I+cr 2 (S^ 1 — S^ 1 ) is positive definite, 
in order to ensure the convergence of the integral. So we have the following two conditions for 
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M0,cr 2 I) 

N(0,S!) -< N(0,S 2 ): 

I + cx 2 (S^ 1 - S^ 1 ) is positive definite; (17) 
and (S^Sil < |I + a 2 (S2 1 - Sf 1 ) |. (18) 

Now as N grows without bound, consider a WSS zero-mean Gaussian process {Y n } with two 
possible PSDs (f>i(uj) and faiuj), w G [ — ^i 71 "]- Denote the probability measures of a length- iV 
segment of {Y n } under 0i(-) and (foO) by Pjv.i an d -P/v,2> respectively. Applying the asymptotic 
properties of Toeplitz matrices (see, e.g., [18, Thm. 5.4]) to the conditions (fT7l)-(fl"8~l). we find 
that if 

1 r Mu) , 1 / a 2 a 2 \ , 

— / l g^-du<- log 1 + - U, (19) 

holds, and 1 + a 2 / <p 2 {oj) — a 2 /4>\{uj) is bounded away from zero for all w G [— 7r, 7r], then P/v,i 
is dominated by P N 2 with respect to N(0, ct 2 Itvx7v) for all sufficiently large iV. The condition 
(fT9l can further be rewritten as 

'l-J iW^) ^]^! (20 ) 
2^7^ v 0i(w) 

Definition 3: Consider a set of PSD functions S. A PSD </>*(•) G S is cr 2 -dominated by S if 
for every </>(•) G S, 1 + cr 2 /0(w) — a 2 /4>*{uj) is bounded away from zero for all w G [— 7r, 7r], and 

a?/. log l [fHF + ^Rj d ^ a <21) 

a 2 

We denote the a -dominance relationship by </>*(•) -< S. 

For the purposes of this paper, we further focus on the a 2 -translation of the PSD set S, obtained 
by adding a noise floor of a 2 to each element PSD of S; that is, 

S [(j2 ] = K + :<£(•) (22) 
According to Definition [3l a 2 + </>*(•) G Suai is dominated by S^j if for every </>(•) G S, 

j_ r i oe d + gfeo 

2W-. V [a 2 + 0*(o;)] 

This is the same as the dominance condition © in Theorem [TJ 



log ( 1 + y \T ^ ; i2 V n )dcu>0. (23) 
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III. Asymptotic Behavior of Detector Sequences Based on Gaussian Mixtures 
Consider an arbitrary finite number, K, of possible PSD functions, 

S = {&(.), &(•),■ --.MO}- ( 24 ) 

In S, we always keep the dominated PSD </>*(•) and index it as me other (K — 1) PSD 

functions are arbitrarily sampled from U^. For convenience, denote the [a 2 + fc (-)] -induced 
covariance matrix of the iV-dimensional Gaussian distribution by <t 2 Inxn + Ejv,fc» and its PDF 
by p N ,k- 



PN,k(y) = ( 27r )JV/2| -2 I+Sjvfc |l/2 [~0-/ 2 )f (° 2 I+^N,k) l V 

Also denote by p^,o the PDF of the A/-dimensional Gaussian distribution under "K 



(25) 



pnAv) = (27r(j2)jV / 2 ex P [-y T y/(2° 2 )] • (26) 



We consider detector sequences whose decision statistics take the following form: 

PN,k(y) 



9N(y;q) = Tf lo &E 9fc " , , 



k=l 
K 



k=l 1 



qk 

exp 



N |I + EW<t 2 |V2 



'" y T (a x I + i: Ntk )- 1 i: N , k y 



2a^ 



(27) 



where the vector q satisfies the normalization condition ^2 k=1 q k = 1, <Zi > 0, and qk > 0, 
V/c 7^ 1. Note that we restrict the component q\ corresponding to </>*(•) to be strictly positive. 
Indexed by N, the considered sequence of detectors are deterministic threshold tests, 

if g N (l£,q) < t n , 5 N (y) = 3t ; otherwise, 5 N (y) = JCi (28) 

with thresholds {r N }. For each N, r N is determined through the constraint that the false alarm 
probability is fixed as a, i.e., 

/ PnMdy = a. (29) 

•J 9N(y\g)>TN 

In this section, we investigate the asymptotic behavior of <?jv(H; q) when Y_ follows CK , as 
N grows large. 

'We shall use these two notations interchangeably in the sequel. 



May 3, 2010 



DRAFT 



10 



For each k — 1, 2, . . . , K, we can define a quantity 



io g (i + fc H/a 2 ) 



fc (w)/o- 2 



dcj. 



The first step in our investigation, Lemma [3l indicates that </>*(■) attains min^fe- 
Lemma 3: 



(30) 



min^fc = t~ 
k Air 



iog(i + fH/^) 



0*( W )/a 2 



(3D 



l + 0*(w)/(x 2 _ 

Proof: As we have noted regarding the error exponent T in the introduction, ip k is the limit of 

JjD(PN,o\\PN,k) ■ 

So in order to prove the result, we consider the following related "convexified" problem 

K 



nun —D I p Nfi 



^2 rkPN ' '' 



(32) 



fc=i 



where r G [0, 1] A satisfies ^j[Li r A: = 1. If we prove that for every sufficiently large N, the N- 
dimensional probability distribution induced by </>*(■) solves (l32l) . then it also solves the original 
problem of minimizing ip^. 

Since the Kullback-Leibler distance is convex with respect to its operand distributions, the 
KKT conditions [17] provide necessary and sufficient conditions for optimality, as 



1 F 



PN,k 



Lfc=l r kPN,h 



(33) 
(34) 
(35) 



+ fik - A = 0, Wk; 
fi k > 0, Wk; 
= 0, Vfc. 

So, if r = [1, 0, 0, ... , 0] (i.e., </>*(•)) is the minimizer of (1/N)D (pn,o J2k=i r kPN,k^j, we have 
/Ui = 0, which when substituted into (1331) leads to 



PiV,l 



+ - A = ^ A 



1 

TV' 



Substituting A = 1/N into |33]) for k ^ 1 leads to 



E 



PiV,0 



PiV,l 



1 = -Nfi k < 0, VA; ^ 1. 



(36) 



(37) 



As N grows large, this results in the dominance condition ©, according to the development in 
Section HO So Lemma [3] is established. □ 

The following two lemmas then characterize the asymptotic behavior of (7at(H; q) under Ji . 
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Lemma 4: Under the dominance condition ©, for every q with q\ ^ 0, the threshold sequence 
{t n } converges to log (1 + 0*(w)/cx 2 ) - ^ffjy^ du as N oo, for every fixed 

false alarm probability < a < 1. 

Lemma 5: Under the dominance condition ©, for every q with qi ^ 0, the decision statistics 
satisfy 



}™L E pn,o [9N(Y;q)} = - — 



JV-s>oo 



log(l + 0»/a 2 ) 



dbj. 



(38) 



Proof of Lemma® In light of Lemma[3l the result would straightforwardly follow if we prove that 
under !K , the sequence of decision statistics, {gjv(H; <?)}> converges to — \am k i\) k in probability. 
We do so using a sandwich type of proof technique. On one hand, (?at(H; q) is lower bounded 
as 



9n(Y) q) 



1 K 



> 



N 
1 



k=l 

PNJkOO 



PNflOO 



at log q k (v , 
iV ° g ll+S^/^IVa 



exp 



2a- 



+ (39) 



for every A;. On noting that under 3"C Y_ is an iV-dimensional Gaussian random vector with 
covariance matrix <r 2 I, (f39|) can further be rewritten as 

"JV-l JV-l 

£ A fc , n W„ 2 - £ log 



iV 



logg/t 



N 



(40) 



_rc=0 n=0 

where \ k)n denotes the n-th eigenvalue of (l/2)(a 2 I + X^fe) -1 ^-*/,*:* ^k,n denotes the n-th 
eigenvalue of (1 + Eat^/ct 2 ) 1 ^ 2 , and {W n }^Zo are i.i.d. zero-mean unit-variance Gaussian ran- 
dom variables. Then from Chebyshev's inequality and the asymptotic properties of Hermitian 
Toeplitz matrices (see, e.g., [18]), limjv->oo S'atQI; <z) is lower bounded by 



1 

47T 



log (l + fc ( W )/a 2 ) 



(f) k (u)/a 2 



doj 



-A 



in probability, for every k such that q k ^ 0. So the tightest lower bound yields lim^v^oo 9n{Yj q) > 
— min fc ip k in probability. 

On the other hand, we wish to prove that for any small e > 0, as N grows without bound, 
9n{Yj, q) < — min fc ip k + e with vanishingly small probability. For this, it suffices to prove that 
for every k > 1 with q k ^ 0, PnuOO * s exponentially smaller than Pn,i0O (which is induced 
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by a 2 + </»*(■)) with high probability. This also follows from similar steps as those used in 
establishing the lower bound above. Consequently, Lemma @] is established. □ 

Proof of Lemma \5\- Similar to Lemma SI the proof is also based on a sandwich type of 
technique. The lower bound of E PJV [g^Yj, q)] follows essentially the same line as in establishing 
the lower bound in Lemma and we have 



lim E PN0 [g N (Y;q)} > - — 

iV— >oo — 47T 



log(l + 0»/a 2 ) 



1 + <p*(u)/a< 



du. 



(41) 



To establish an upper bound, we note that 

E PJV , [g N (Y_-q)} 



Ie 

N 



k=l 



PN 



lo § 



Pn,o{Y_)\ 



1 



i+ E 



Qk PN,k{Y) 



In m, the first term converges to - i [log (1 + <P*(co)/a 2 ) - 
lower bounding procedure; the second term can be upper bounded as 



(42) 



Qi Pn,i(Y) 

doj following the 



1 F 

N PN 



o lQ g 



E 



Qk PN,k(Y) 
Qi Pn,i(Y_) 



< 1 V 

k^l,q k ^0 HL 



PN,k(Y) 

Pn,i(Y) 



since log(l+a;) < x for all x > — 1. Now it suffices to prove that for every k ^ 1, E PJV0 



(43) 

pnAY-) 
pnAZ) 



is bounded. From the development of <r 2 -dominance in Section HH for all sufficiently large N, 
this condition is implied by the dominance condition ©. This concludes the proof of Lemma 

El □ 



IV. Proof of Theorem CD 

In this section, we use the auxiliary results developed in the previous sections to establish 
Theorem Q] We shall consider the hypothesis testing problem (OQ) over an arbitrary K-point set of 
possible PSD functions S, which contains </>*(■) as 0i(-) and another (K — 1) arbitrarily sampled 
PSD functions from IX^. Once we prove that for any such S, LRT detectors with respect to 
</>*(•) achieve the minimax robust error exponent T MR , for every < a < 1, then Theorem Q] 
straightforwardly follows through a contradiction argument. 
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According to Chernoff's bound, the miss probability of the decision procedure using {g^iy] <?)> t n} 
is upper bounded by 



Pr[MH) = 0|5Ci] < exp <^ -N ■ sup 



s<0 



N 



1 

N 



logE Pjv [e^l)} 



(44) 



where the expectation is with respect to pn, the distribution of Y_ under CH^. So from Lemmas @] 
and|51 for any e > 0, there exists a sufficiently large N e , such that for all iV > N € , the Chernoff's 
bound gives 



Pr[MH) = 0|JCi] < exp <{ -JV • sup 

s<0 



£ (E mo [^g)] + e) - ^\ogE PN [e»«<Z& 



•(45) 



As e — > 0, we pose the following minimax problem to optimize the minimax robustness 
performance of iV-dimensional decision-making under the Neyman-Pearson criterion: 



max mm sup 

q k=l,2,...,K s <q 



^-E PNfi [ 9N Qaq)] - ^logE PiV , fc [e^CEs) 



(46) 



N ~FN,0 la-Li ^ -z/j N 

To proceed using the minimax robustness theory [4], we augment the sets in problem (|46l) . 
Instead of restricting q x to be strictly positive, we consider q G CP, where 

0>= jzG [0,1]*: X>* = lJ- (47) 

Instead of considering probability distributions induced by the K isolated PSD functions in §, 
we consider the PDF of F as a convex combination of {pn,i,Pn,2, ■ ■ ■ ,Pn,k}, as 

pn(v) e I r kPN,k(y) : r k = l; n> > o, vfc I . (48) 
lfe=i fc=i J 

Note that in general pat corresponds to a mixture of iV-dimensional Gaussian distributions, unless 
r is a "singleton", z'.e., all but one component of r are zeros. For convenience, we write (|48T) 
as PN(y,L) m order to reflect its dependence on r. For the detectors sequences with decision 
statistics (?at(?/; g) in the form (|271) . when q = r, g^iv] L) is me log-likelihood ratio test (LLRT) 
statistic. 

Now we consider the augmented minimax problem 

■ S '~ r 1 1 logE PN{ , t) [e>'«QW] 



max mm sup 

q&T r&y s<0 



:E PNfi [g N (Y;q 



j\j—PNfi L^ JV V— ' 2,/J — o— c.vr.i.1 | I ' (49) 

Since the sets in (1461) are subsets of those in (|49| ), if we can prove that pat,i (which is induced 
by 0*(-)) and its associated LRT solve (|49|) . then they also solve (|46l) . In the following, we prove 
the minimax robustness result for (l49l) . through following the general approach developed in [4]. 
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Consider the minimax problem (1491) as a game, in which the utility function is 

UN{q,r) = sup 



s<0 



S :B PNfi [g N (Y;q)} - 1 log E pjv( . ;r) [e^^] 



Both the allowable filter q and the possible operating point r are taken from CP = {x G [0, 1] K : 
X/£Li x fc = 1}' the space of all ^-dimensional probability mass functions. For a given r, we 
find that a test statistic that maximizes Un(q, Zl) is the log-likelihood ratio function gN(y,L) — 
(1/N) ■ log J2k=i r kPN,k(y)/PN,o(y) ■ hi conjunction with the choice of s = — AT, this LLRT 
statistic leads to 



maxU N (q,r) = —D \ p N>0 
q - iv 



(50) 



fc=i 



So if r* G CP minimizes D (pn,o J2k=i r kPN,k^j , it is a least favorable operating point of the 
game. We now show that this least favorable operating point and its associated LLRT statistic 
constitute a saddle point for the game, and hence solve the minimax robustness problem, by using 
[4, Thm. 2.1]. First, the set of all i^-dimensional probability mass functions, CP, is a convex set by 
its definition. Second, due to the concavity of logarithmic functions and the supremum operation, 
the utility function U^{q^r) is convex with respect to r on CP, for every q. 

It remains to be shown that (<7jv(* ;£*),£*) is a "regular pair", that is, if for every r G CP and 
every sufficiently small > 0, the perturbed distribution J2k=i [(1 ~ fi) r *k + @ r k]PN,k satisfies 
max,(/ w (g, (1 - /3)r* +/3r) - U N {r*, (1 - (3)r* + (3r) = o{(3) where o((3)//3 ->• as p -> 0. The 
optimal test statistic in response to [(1 — (3)r* + (3r\ is its corresponding log-likelihood ratio 



g N (y; (1 - /3)r* + pr) = — log 



Ef = i[(l-/9)rjE + /3r fc ] Pj v, fc (y) 

p*r,o(y) 



and it follows that 



max U N (q, (1 - p)r* + fir) 
1 

w Inch behaves for /3 <C 1 like [19] 



max U N (q, (1 - p)r* + pr) 
q - 



^S D \ PNfi 



1 

N 



D Pn,i 



A 



£[(l-/?K + /3 



(51) 



fc=i 




E 



pjv(-;r) 



EtirlPN,k(Y) 



P}+o{P), (52) 
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where the expectation is with respect to J2k=i r kPN,k- On the other hand, Ujsr(r*, (1 — (3)r* + (3r) 
is lower bounded by setting s = —N, 



U N (r*,(l-(3)r*+(3r) 

K \ 

r iPN,k ) - iogEp JV( .. ( i_^ I * +/3r) 

k=l / 

r kPN,k - log 
k=l J 
K 

T kPN,k 



PNfiQO 



ELirlPNAX.) . 

mo(r) 



iV 



D Pn,i 



k=l 



E 



1 - (3 + (3 ■ E PJV (. ;I ) 
PAr,o(Z) 



EtirlPNAX.) 



0}+o{(3). (53) 



A direct comparison between (l52l) and (l53l) then reveals that 

< maxU N {q, (1 - /3)r* + f3r) - U N {r*, (1 - (3)r* + (3r) < o{(3), 
1 ~ 

hence establishing the regularity of {gn{') ZL*)- 

Finally, from Lemma [31 under the dominance condition ©, for every sufficiently large N, 
the probability distribution p N>1 induced by </>*(■) solves 



min —D p Nfi 




(54) 



So {pn,i} and its associated LRT detector sequence achieve the minimax robust error exponent. 
This concludes the proof of Theorem [Q 

V. Concluding Remarks 

Characterizing the minimax robust error exponents of hypothesis testing problems under 
modeling uncertainty has been a longstanding problem. This is especially the case when signal 
processes exhibit temporal correlation as described by PSDs, since even if the PSD uncertainty 
set is convex, the set of induced probability distributions generally loses the convexity property, 
which is usually pivotal to the existence of minimax robust detectors. In this paper, we have 
considered the scenario of detecting a WSS Gaussian signal processes embedded in white 
Gaussian noise, where the uncertainty is only with respect to the PSD of the signal process. 
Our treatment of the problem is based on a dominance condition, instead of the usual convexity 
condition, for the PSD uncertainty set. Under such a dominance condition, the minimax robust 
detector sequence and the resulting minimax robust error exponent are both identified. Potential 
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future directions of interest include extending the approach in this paper to more general detection 
models, incorporating noise uncertainty or non-Gaussian signal/noise distributions, and exploring 
applications of the dominance structure among probability distributions in other problem settings. 

References 

[I] Y. Sung, L. Tong and H. V. Poor, "Neyman-Pearson Detection of Gauss-Markov Signals in Noise: Closed-Form Error 
Exponent and Properties," IEEE Trans, Inform. Theory, Vol. 52, No. 4, pp. 1354-1365, Apr. 2006. 

[2] W. Zhang, H. V. Poor and Z. Quan, "Frequency-Domain Correlation: An Asymptotically Optimum Approximation of 
Quadratic Likelihood Ratio Detectors," IEEE Trans. Signal Process., Vol. 58, No. 3 (Part 1), pp. 969-979, Mar. 2010. 

[3] S. A. Kassam and H. V. Poor, "Robust Techniques for Signal Processing: A Survey," Proc. IEEE, Vol. 73, No. 3, pp. 
433-481, Mar. 1985. 

[4] S. Verdu and H. V. Poor, "On Minimax Robustness: A General Approach and Applications," IEEE Trans. Inform. Theory, 

Vol. 30, No. 2, pp. 328-340, Mar. 1984. 
[5] P. J. Huber, "A Robust Version of the Probability Ratio Test," Ann. Math. Stat., Vol. 36, pp. 1753-1758, 1965. 
[6] R. D. Martin and S. C. Schwartz, "Robust Detection of a Known Signal in Nearly Gaussian Noise," IEEE Trans. Inform. 

Theory, Vol. 17, No. 1, pp. 50-56, Jan. 1971. 
[7] R. D. Martin and C. P. McGath, "Robust Detection of Stochastic Signals," IEEE Trans. Inform. Theory, Vol. 20, No. 4, 

pp. 537-541, Jul. 1974. 

[8] S. A. Kassam and J. B. Thomas, "Asymptotically Robust Detection of a Known Signal in Contaminated Non-Gaussian 

Noise," IEEE Trans. Inform. Theory, Vol. 22, No. 1, pp. 22-26, Jan. 1976. 
[9] A. H. El-Sawy and V. D. VandeLinde, "Robust Detection of Known Signals," IEEE Trans. Inform. Theory, Vol. 23, No. 6, 

pp. 722-727, Nov. 1977. 

[10] H. V. Poor and J. B. Thomas, "Asymptotically Robust Quantization for Detection," IEEE Trans. Inform. Theory, Vol. 24, 
No. 2, pp. 222-229, Mar. 1978. 

[II] H. V. Poor, "Robust Decision Design Using a Distance Criterion," IEEE Trans, on Inform. Theory, Vol. 26, No. 5, pp. 
575-587, Sep. 1980. 

[12] R. J. Barton and H. V. Poor, "An RKHS Approach to Robust L 2 Estimation and Signal Detection," IEEE Trans, on 

Inform. Theory, Vol. 36, No. 3, pp. 485-501, May 1990. 
[13] D. Kazakos, "Signal Detection under Mismatch," IEEE Trans. Inform. Theory, Vol. 28, No. 4, pp. 681-684, Jul. 1982. 
[14] E. A. Geraniotis, "Performance Bounds for Discrimination Problems with Uncertain Statistics," IEEE Trans. Inform. 

Theory, Vol. 31, No. 5, pp. 703-707, Sep. 1985. 
[15] C. Pandit, S. Meyn and V. V. Veeravalli, "Asymptotic Robust Neyman-Pearson Testing Based on Moment Classes," in 

Proc. IEEE Int. Symp. Inform. Theory, Chicago, IL, Jun. 2004. 
[16] H. V. Poor, "Minimax Linear Smoothing for Capacities," Annals of Probability, Vol. 10, No. 2, pp. 504-507, May 1982. 
[17] D. G. Luenberger, Optimization by Vector Space Methods, John-Wiley & Sons, Inc.: New York, 1969. 
[18] R. M. Gray, Toeplitz and Circulant Matrices: A Review, now Publishers: Hanover, MA, 2006. 

[19] W. Zhang and U. Mitra, "Orthogonal Codes for Robust Low-Cost Communication," IEEE Trans. Inform. Theory, Vol. 54, 
No. 12, pp. 5411-5426, Dec. 2008. 



May 3, 2010 



DRAFT 



